Structural Analysis and Optimal Design of Distributed System Throttlers

摘要

In this paper, we investigate the performance analysis and synthesis ofdistributed system throttlers (DST). A throttler is a mechanism that limits theflow rate of incoming metrics, e.g., byte per second, network bandwidth usage,capacity, traffic, etc. This can be used to protect a service's backend/clientsfrom getting overloaded, or to reduce the effects of uncertainties in demandfor shared services. We study performance deterioration of DSTs subject todemand uncertainty. We then consider network synthesis problems that aim toimprove the performance of noisy DSTs via communication link modifications aswell as server update cycle modifications.